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SYSTEM FOR PRODUCING PERSONALIZED A limitation of such systems is that, by their nature, they 

VIDEO RECORDINGS can only provide background for a user's performance, and 

may require the user,s signal to be keyed which, as men- 

RELATED APPLICATION tioned above, may be diflGcult to achieve reliably with 

. . . ... ^ ,.5 consumer quality equipment. 

lliis apphcation is a contmuation-m-pan of my applica- 
tion Ser. No. 08/399,013, filed Mar. 6, 1995, now aban- SUMMARY OF THE INVENTION 
doned. 

In its broadest aspect, the present invention relates to a 

FIELD OF THE INVENTION system in which a prerecorded video signal is prekeyed to 

define background areas which, on playback by a user of a 

This invention relates to the production of video recording medium carrying the keyed signal on apparatus 

.sequences, in which users own video signal can be combined configured to recognize the prekeyed background areas, will 

with a prerecorded video signal to provide a composite generate a signal into which may be inserted, in those 

sequence, in which prerecorded images are integrated with background areas, a local signal provided by the user, which 

the user's own material. 15 ^g^d not itself be keyed. 

REVIEW OF THE ART present invention further seeks to provide a system in 

which a keyed video prerecording is used to provide a 
So called video karaoke systems are well known in which prerecorded signal which is combined with a user provided 
a video recording is provided, with the video display over- background signal to provide a final combined signal, the 
laid by text indicating the words of a song, usually with prerecording including prompt channel, which can be sup- 
some form of marker to indicate the synchronization of the pressed in the final combined signal, to assist a user and/or 
words of the song with a musical accompaniment recorded a user's equipment to provide a background signal oompat- 
on the sound channel or channels of the video recording. ible with the prerecorded signal. 

This enables persons viewing the recording to "sing along" ^5 According to the invention, there is provided a system for 

with the musical accompaniment. the production of video signals, comprising a playback 

It is also well known to produce composite video signals device for playing back prerecorded video and audio signals 

y by overlaying one signal on another, utilizing one of several from a prerecorded storage medium, a source of user sup- 

O keying techniques of which those known as chroma-keying plied video and audio signals, a video and audio mixer for 

ffd and luminance keying are the most common. In chroma- 30 combining the prerecorded and user supplied signal to 

7-." keying, essential elements of a foreground scene, typically a provide combined video and audio outputs, a production 

^1 person or persons, are imaged against a background having monitor connected to the mixer to display to the user the 

a higher levefof saturation" cTf^paHicuraFcolouFlhah is niixed signals, and"asforageror reprodu"ctibn*device"receiv- '~ 

y|. likely to occur in the foreground objects. Typically an ing a mixed video signal output from the mixer, wherein the 

~ intense blue background is utilized, but other colours may be 35 prerecorded storage medium stores, as well as a video 

« used provided that, in the particular application, they enable channel and at least one audio channel, at least one prompt- 

the foreground and background to be reliably differentiated ing channel, the video signals stored on the prerecorded 

F3S by signal processing circuitry. An alternative approach is medium being prekeyed to indicate areas to be overlaid in 

lif known as luminance keying, in which it is arranged that the the mixer by the user supplied video signals, and the mixer 

■Q luminance level of the background against which the fore- 40 being operative to convert signals from the prompting 

0r| ground objects are imaged is consistently and detectably channel into production control signals. Typically the pro- 

J." lower than that of the wanted foreground objects. During the duction control signals include prompts displayed on the 

« combination process, boundaries between the foreground production monitor but absent from tlie combined video 

Mb objects and the background are detected on the basis of the output. 

above-mentioned difference in colour content or luminance 45 The invention extends to a recording medium providing 
level, so as to produce a switching signal which switches a multiple channels of information, including a video channel, 
second video signal, synchronized with the first, into the a least one audio channel, and at least one prompting 
background areas. These techniques are well known and channel, the video channel being recorded with a video 
understood in the art, but require good quality and hence signal prekeyed to indicate picture areas available for over- 
expensive equipment to operate reliably. 50 lay by a user provided video signal, and the prompting 
In U.S. Pat. No. 5,099337 (Cury) it is proposed to provide channel including data translatable into instructions for 
a selection of background audio and video recordings which control of the user provided video signal, 
can be selected fi-om separate libraries and combined with In order to permit production of prerecorded tapes (or 
foreground audio and video signals provided by a user, so as discs or other media) which will perform reliably with low 
to enable the user to provide customized video recordings in 55 cost user equipment, I employ by preference a modified 
which the users own foreground images and audio signals luminance keying system in producing the prerecorded 
are superimposed upon selected background audio and video tapes. In simple terms, the brightness level of at lease the 
signals, 'lliis in effect provides system in which the user, as lowfights of portions of images which are not to be overlaid 
well as providing a foreground audio signal, also provides a by the user signal is artificially enhanced so that the "black 
foreground video signal, and is provided with means for 60 level" of retained image portions is well above the normal 
recording the result. A performer performs in front of a blue black level of a recorded signal, thus enabling the keyed 
screen, so that the performer^s image may be chromakeyed portion which is at or below the normal black level, to be 
into the background video signal, thus providing the illusion readily distinguished. The user supplied signals are also 
that the performer is performing in the selected background. brightness enhanced in a similar manner prior to mixing 
During performance, prompt information is provided to a 65 with the signal from the prerecorded tape, and the brightness 
performer through a prompt monitor from a prerecorded level of the mixed signal is then returned to normal so as to 
prompt library. restore the original black levels. 



6,072,933 

3 4 

The word "video signal" as used in this specification, to control its input to the mixer 12, which replaces the keyed 

means a television type video signal consisting of a portionsof the signal from the prerecording 2 with the signal 

sequence of frames which when reproduced in radial sue- 10 from the camera 8. It is however preferred that zooming 

cession are capable of providing a moving picture. It does be performed electronically within the mixer, because of the 

not include bit-mapped or vector digital representations of a 5 lack of standardization of camera controls. The signals 4 and 

single static image. 10 must of course be synchronized to a common set of 

scanning signals before combination. This is preferably 

SHORT DESCRIPTION OF THE DRAWINGS achieved as discussed below with reference to FIG. 3, but in 

In the drawings: ^" alternative arrangement the camera 8 receives a signal via 

1 . • i r 1 ui 1 1- r .u . 10 control 14 which synchronizes it to the signal 6 from the 

FIG. 1 is a simplified block diagram of the system: , . •^rp, , , . , ^ . , 

^ ^ ^ ' prerecorded source. The output signal from the mixer 12 is 

FIG. 2 IS a simplified block diagram of a mixer unit used passed to a suitable recorder and/or display 16. 
m the system; Refening now to FIG. 2, this shows schematically one 

FIG. 3 LS a more detailed block diagram of an exemplary embodiment of the mixer 12 in somewhat more detail. Video 

mixer unit; and ^5 inputs 4 (including the signal 6) and 10 are applied to a 

DESCRIPTION OF THE PREFERRED timebase control unit 20 which ensures synchronization 

EMBODIMENT between the video signals, preferably by applying them to 

synchronized frame memories as described below, since this 

Referring to HO. 1, which has been simplified by omit- requires no feedback control of the timing of either input 
ting any consideration of sound as opposed to video 20 signal. A brightness enhancement circuit 21 may be pro- 
channels, a prerecorded tape or video disk, generically vided in one advantageous embodiment of the invention to 
referred to as a prerecording '2, is replayed to provide a enhance the brightness of the lowlights of the user supplied 
foreground video signal upon which a user signal may be video signal so that its black levels are well above the 
overlaid using chroma or luminance keying or any other pedestal level of the video signal by an amount equal to a 
system enabling effective identification of areas of the 25 similar brightness boost already present in unkeyed image 
recorded image available for overlay by a user signal areas of the prerecorded video signal in unkeyed areas, 
(henceforward generically referred to as "keying") It should keyed areas being maintained at or slightly below normal 
be understood that the keying signal, whatever form it takes, black level. This distortion of the prerecorded video signal 
for example a high saturation of blue, or a very low enables the keying switcher to detect keyed areas very 
luminance level, is already built into the prerecording 2 so 30 simply and reliably since there will be a substantial mini- 
as to predefine those areas of the prerecorded signal 4 nium difference of the level of the video signal in keyed and 

available for overlay by user provided video sjgnals^^theuser unkeyed areas which can readily _b^dcjccted even in the 

provided signals will not usually themselves be keyed, and presence of some distortion of the video signal/rypicaTlyT ' 
if they are keyed, it will be for purposes extraneous to the this enhancement may be about 20% or more the normal 
present invention. It should also be understood that overlay 35 difference between black and white levels of the signal. 'I'he 
effects depend on successive fields of the prerecorded video brightness enhancement applied to the user signal by the 
being keyed in certain areas, fields may also be either wholly circuit 21 should of course be substantially the same as that 
keyed or not keyed at all, thus permitting scenes provided applied during manufacture of the tape providing the signal 
whollycithcrby the user or wholly by the prerecorded tape. 4. Downstream of the switcher 22, a further brightness 
The prerecorded tape also preferably carries, as well the 40 control circuit 23 applies an equal and opposite correction to 
video signal channel, at least one audio channel for audio restore proper brightness levels in the signal. A level switch- 
signals, and at least one prompting channel 6 for prompting ing circuit 22 responds to the keying signal extracted from 
signals prompting of instructing the user and/or the users the signal 4 to switch between levels of the signals 4 and 10 
equipment so as to assist in rendering the content of the user and thus provide a combined video output signal 24 to the 
provided signal compatible with the foreground content of 45 recorder and/or display 16 (FIG. I). For full keying the 
the prerecording. Prompts to the user may include text different levels of the two signals are full/zero and zero/full 
prompts, e.g. the words of a song and/or stage directions, or respectively, but other level combinations can be utilized 
position of dimension indicators to assist the user in con- with suitable digital mixing technology, in a manner known 
trolling direction or zooming of a video camera providing per se. The video output signal is also applied, in this 
the user signal. It should further be understood that the 50 embodiment, to a closed caption decoder 28 which extracts 
playback of the prerecording may occur at a remote point, control signals and which arc encoded into an available 
with the signal being distributed to users over a distribution channel in the prerecording 2, in this case that portion of the 
network such as a CATV network or the internet. video interval between frames normally reserved for closed 

A controllable user video source, usually a camera 8 (or captioning. The control signals are overlaid on a video signal 

one of multiple selectable cameras) has a signal output to a 55 26 sent to the monitor 14 (FIG. 1), so as to provide directions 

mixer 12 which combines the video signals by inserting the (either text prompts or instructions or positioning marks) to 

user signal output 10 in those areas of the prerecorded signal the user of the system so that the user may "sing along*' or 

4 which are identified by the keying, or by mbcing the user otherwise perform in synchronization with the prerecorded 

signal with the prerecorded signal, depending upon the effect signal, or exercise suitable control over the camera 8. The 

desired. The superimposilion provided by mixing may be 60 signal 26 may also be decoded to provide a camera control 

useful for some applications for example training videos. output, for example a zoom control signal. The mixer 12 

Tlie prompting signals on channel 6 are translated by the typically also incorporates an audio effects and mixer unit 30 

mixer 12 into signals displayed on a user monitor 14 so that which receives and mixes inputs from an audio channel or 

a user may control the camera 8, or sing (or otherwise channels 32 from the prerecording 2, inputs from an audio 

perform) along with a prerecorded artist; or the user monitor 65 channel or channels 34 from a user microphone or 

may implement a camera control function (for example a microphones, and provides an output audio channel or 

power zoom control) which Is applied directly to the camera channels at 36 to the monitor 14 and at 38 to the recorder 16. 
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Referring now to FIG. 3, one version of the mixer 12 is video outputs 24 and 26 via amplifiers and filters 154 and 

shown in more detail. It should be understood that, in the 156, the V signal to encoder 152 being overlaid by text or 

main, the mixer 12 shown in FIG. 3 is similar to known video regenerated by the overlay generator 146 so that 

digital video mixers incorporating chroma or luminance control instructioas are passed to the user monitor 14. 

keying facilities except that it responds additionally to an 5 The microcomputer 102 may control additional optional 

additional prompt channel included in the prerecorded video proce.ssing circuits between the multiplexer 142 and the 

input 4. Typically the closed caption channel, the data for encoder 150 and 152, these being of types known in digital 

which IS encoded into certain lines of the video signal in the video mixers; in this case there is shown a zoom interpolator 

vertical interval outside of the normaUy displayed area, is i60, a scaler 162 controlled by a clock generator 164, and a 

used to convey prompt messages and control data to the lo lower bit switch 166. The zoom interpolator and scaler 

system, and thus a closed caption decoder 100 is incorpo- provide an electronic zoom effect which is preferred to 

rated into the mixer 12 to recover this data. Such decoders optical zoom controUed by the line 48. The electronic zoom 

are well understood in the art and need not be described interpolator and scaler will act on the combined signal, and 

not just the local camera input as would an optical zoom. 

The mixer operates under control of a microcomputer 102 15 lower bit switch 166 can be activated in known manner 

including appropriate working memory. An example of a to provide a posterization cftect. The interpolatcr 160 and 

suitable device is the 87C752 from Intel Corporation, and in scaler 162 may also be configured to be controlled manually 

general it controls the mixer in a manner similar to that of by the user, since they act conjointly on the prerecorded and 

known video mixers. Accordingly, the mixer will be user provided signals. 

described primarily with a view to explaining how it differs 20 ^^^-^ ^^^^ 33 ^^q^, j^^,^ microphones are processed by 

from conventional digital video mixers, such as the MX-1 potentiometer 168, preamplifiers 170, mixer 172, and a 

digital video mixer from Videonics (although it should be master potentiometer 174 before being appUed to an A/D 

understood that many of the functions provided by such converter 176 while audio inputs associated with the prere- 

mixers are not essential to the present application and may corded video signal are applied to A/D converters 278, the 

L,^ be omitted to reduce costs), and so as to explain its rela- 25 ^j^pm^ ^qj^ converters 176 and 178 being com- 

y tionship lo the essential functions of the invention. ^ined and optionally processed by a digital signal processor 

Q Tlie video input 4 from the prerecorded source 2 may be 180 in known manner under control of microcomputer 102. 

s=s either composite or S-video. In the latter case the video The processed digital audio signals are then passed through 

Z: chroma and luminance signals are applied to separate analog digital to analog converters 182 and preamplifiers 184 to the 

pi to digital converters 104, 106 under control of a clock ^ outputs 36 and 38. 

%y generator 108 which also controls a decoder 110 passing xhe programming of microcomputer 102 has not been 

digital-Y (luminance) and-U-and V-(ehrominance) signals to- ^ described,-since-except for-any processing of the- signals" 

, ? a frame memory 112 under control of a video memory write from the closed caption decoder 100, it is similar to that for 

H controller 114. If a composite video signal is provided, it is known digital mixers. Processing by microcomputer 102 of 

g applied to the converter 106 and converter 104 is not used. closed caption data merely consist of intercepting data 

Similarly, the input 10 from the camera 8 is applied to A/D encoded on the closed option line 20 which provides control 

, converters 124 and 126, or converter 124 only if a composite signals for passage by the microcomputer to the output 148 

1 y signal, under control of a clock generator 128 also control- or the processing circuits 160, 162 and 166. 

O ^^"S a decoder 130 passing signal to a memory 132 under ^ use, the mixer 12 will operate much like a conventional 

gf| control of controller 134. digital video mixer, except that the keying function con- 

A synchronized memory read controller 140 reads the trolled by the keying signal in the input 4 is a default 

contents of the memories 112 and 132 in synchronism under function, and control signals or messages in the closed 

\^ control of the microcomputer 102, the Y, U and V signals caption field of the input 4 are decoded and output cither as 

read from the memories being selected by a multiplexer 142, 45 video overlays on the monitor 14 or as camera or mixer 

under control of a luminance or color keyer 144 itself control signals. 

controlled by signals read from the memory 112. When the n ^-^ therefore be appreciated that a users local generated 

selected keying signal, be it luminance or chroma, is present ^j^eo (and audio) signals may be combined with the video 

at a level denoting background, then the keyer causes the ^ prerecorded tape or disc to provide video and 

multiplexer 142 to pa.ss at least part of the signals derived 50 audio outputs in which user contributed images and sounds 

from input 10 and block at least part of the signals from input ^re combined with those on the prerecorded tape to provide 

4; otherwise It passes at least part of the signals denved from ^ composite output in which prerecorded images arc inserted 

input 4 and blocks at least part of the signals denved from i^jQ ^^^agcs provided by the user so that for example a 

input 10. By this meanssignals from the camera inpm ^^^^^^ si^gi^g star or animated cartoon character mav 

inserted mto the keyed portions of the video input 4. 55 appear to be performing together with a user in the uscr4 

The Y (luminance) signal derived from the video input 4 own home or the user's choice of surroundings, llie control 

is also passed to the closed caption decoder 100, which or prompting channel, for example closed captions appear- 

decodes the closed caption data in conventional manner to ing on the monitor 14, may provide on screen prompts to a 

recover data contained therein and pass it to microcomputer user, which are invisible on the output passed lo a recorder 

102 which interprets the data and either forwards it to a go 16, either in the form of words, or indicators indicating how 

conventional overlay generator 146 and/or generates signals the user should place a locally generated image on the 

applied on a Hne 148 to control zooming (for example) of screen. Tliis channel may also carry data which can be 

camera 8, and/or to the scaler 162 or interpolator 160 converted by the microcomputer 102 into data output on the 

discussed below, if provided. line 148 in the form of camera control signals, for example 

The Y, U and V signals from multiplexer 142 are passed 65 to control of a zoom function of the camera 8. Unlike prior 

to output encoders 150 and 152 under control of an output systems, the user does not need to perform agaiast a blue 

clock and synchronization separator 158, providing the screen or other means to generate keying of the user signal. 



